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1 20.  Abstract  (Continued) 


^--'•network  is  that  it  can  be  implemented  with  simple  one-stage  orthogonal-filter  building  blocks  which 
directly  filter  the  input  data  samples.  These  building  blocks  are  the  major  subject  of  this  report,  and  a 
particular  configuration  is  developed  based  on  a  modified  version  of  the  familiar  Howelis-Applebaum 
algorithm.  It  can  be  implemented  in  either  analog  or  digital  form,  data  storage  is  not  required,  it  is 
unconditionally  stable,  speed  of  convergence  is  no  longer  a  problem,  and  the  design  is  simple.  Hie 
performance  characteristics  of  a  complete  orthogonal-lattice-filter  network  operating  in  the  spaciai 
domain  were  simulated  for  example  cases  of  one,  two,  and  three  strong  incoherent  signal  sources 
spaced  within  a  beamwidth  tor  an  eight-element  linear-array  antenna.  The  adaptive  spaciai  filter 
patterns  and  the  transient  responses  demonstrate  that  the  building  block  has  sufficient  transient- 
response  speed  and  control  to  permit  full  use  of  the  processing  capabilities  inherent  in  a  Gram- 
Schmidt  cascade  network. 
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BUILDING  BLOCK  FOB  AN 

ORTHONORMAL-LATTICE-FILTER  ADAPTIVE  NETWORK 

INTRODUCTION 

This  report  presents  the  modification  of  an  old  algorithm  and  its  application  to  a  new 
algorithm  in  order  to  achieve  a  viable  alternative  to  the  conventional  optimum-Weiner-filter 
algorithm.  The  old  algorithm  is  the  conventional  Ho  wells- Applebaum  adaptive-filter 
algorithm  [1] ,  and  it  is  modified  by  incorporating  a  dynamic  time  constant  which  is  a 
function  of  input-channel  powel  level.  This  modification,  when  applied  to  a  one-stage 
orthogonal  filter,  forms  a  building  block  with  the  following  features:  it  can  be  implemented 
in  either  analog  or  digital  form,  data  storage  is  not  required,  it  is  unconditionally  stable, 
convergence  speed  is  no  longer  a  problem,  steering-control  input  is  permitted,  the  design  is 
simple,  and  it  has  great  application  flexibility. 

The  next  two  sections  are  devoted  to  a  comprehensive  description  and  analysis  of  the 
one-stage  orthogonal-filter  building  block.  The  discussion  deliberately  includes  a  consider¬ 
able  amount  of  review  material  because  of  preparation  for  its  application  to  a  complicated 
filter  network  and  also  because  the  digital  equivalents  of  the  Howells-Applebaum  algorithm 
have  received  sparse  treatment  in  the  literature. 

The  new  algorithm  to  which  the  building  block  is  applied  is  the  algorithm  for  a  multi¬ 
stage  multichannel  orthonormal  lattice  filter  proposed  by  Alam  [2] .  He  describes  a  unified 
recursive  technique  to  estimate  the  least-squares  coefficients  of  a  broad  class  of  linear  filter 
models.  In  contrast  with  conventional  algorithms,  his  algorithm  does  not  require  the 
covariance  matrix  to  compute  the  filter  coefficients  but  instead  directly  filters  the  observed 
data  samples.  It  incorporates  a  Gram-Schmidt  orthonormalization  procedure  which  is 
similar  to  cascade  adaptive  processing  networks  described  in  earlier  work  by  Lewis  and 
Kretschmer  [3]  and  also  by  Brennan,  Mallett,  and  Reed  [4] .  The  fourth  section  reviews 
Alam *8  algorithm  briefly  and  develops  the  network  transfer  matrix,  which  is  necessary  to 
show  the  equivalence  to  the  optimum  Weiner  filter. 

A  Gram-Schmidt  orthogonal  lattice  filter  of  just  one  error  output  is  then  selected  as  a 
demonstration  vehicle  for  the  building  block,  and  the  fifth  section  illustrates  its  spacial- 
filter  performance  characteristics  for  simulated  example  cases  of  zero,  one,  two,  and  three 
strong  incoherent  signal  sources  spaced  within  a  beamwidth  of  an  eight-element  linear- 
array  antenna.  For  comparison  the  transient  performance  of  the  familiar  Howells-Applebaum 
algorithm  on  the  same  data  samples  is  included. 


Manuscript  submitted  March  19,  1980. 
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ONE-STAGE  ORTHONORMAL  FILTER 

First  a  one-stage  orthonormal  filter  [2]  will  be  briefly  reviewed  to  establish  the 
concepts  of  the  optimum  weight  and  its  relationship  to  orthogonalization  of  outputs.  This 
also  provides  background  for  the  filter  networks  which  will  be  constructed  from  the  one- 
stage  building  block. 

Consider  the  simplified  sketch  of  a  one-stage  filter  shown  in  Fig.  1.  Let  the  vectors,  V] 
and  V 2  represent  the  sequences  of  discrete-time-sampled  voltages  from  input  channels  1 
and  2,  so  that  there  are  two  m-dimensional  observation  vectors: 


Vj  =  [Vj(l),  V1(2),  V,1(3), ....  Vx(0, 

V2  =  [  V2(l),  V2(2),  V2(3), ....  V2(i), ....  V2(m)] l. 


(1) 


v,  v2 

INPUT  INPUT 


Fig.  1  —  One-stage  orthonormal  filter 


One  of  these  vectors,  V2,  is  chosen  to  be  the  desired  vector ,  and  the  remaining 
vector  Vj  is  defined  as  the  only  vector  in  the  estimation  subspace.  The  multiplication  of 
Vj  by  a  weight  coefficient  2  then  becomes  the  estimate  vector ,  V2: 

V2=-VF12V1.  (2) 
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Also,  an  error  vector  U2  is  defined  as  the  difference  between  the  desired  vector  and  the 
estimate  vector: 


U2  =  V2-V2'  (3) 

In  linear  estimation  theory  a  measure  of  performance  often  used  is  a  loss  function  consisting 
of  the  sum  of  the  squares  of  the  m  error  terms,  that  is,  the  Hermitian  vector  length  of  U2 : 

L(U2)  =  U?  •  u2  =  (V2  +  •  (V2  +  JV12VX).  (4) 


The  “best  performance”  or  smallest  estimation  error  then  consists  of  minimizing  Eq.  (4)  by 
taking  the  derivative  of  the  loss  function  with  respect  to  the  single  weight  coefficient  and 
setting  it  equal  to  zero,  whereupon  the  optimum  or  least-squares  weight  value  is  obtained: 


W12- 


y;1  •  y2 

vl'  •  V, 


£  Vjw  v,(» 

i=l _ 

m 

£  v;<0  Vj(0 

«-l 


(5) 


Equation  (5)  shows  that  this  is  the  same  weight  coefficient  as  obtained  in  the 
familiar  Gram-Schmidt  orthogonalization  procedure  [5] ,  wherein  one  wishes  to  obtain 
a  vector  U2  which  is  orthogonal  to  Vx .  Thus  the  weight  defined  by  Eq.  (5)  results  in  a 
one-stage  Gram-Schmidt  orthogonal  filter  which  also  happens  to  be  an  optimal  estimation 
filter.  This  is  in  agreement  with  the  orthogonal  projection  theorem  used  in  optimization 
theory  [6] ,  which  states  that  the  desired  vector  uniquely  decomposes  into  two  orthogonal 
components:  the  error  vector  and  the  estimate  vector,  where  the  estimate  vector  is  the 
orthogonal  projection  of  the  desired  vector  onto  the  estimation  subspace. 

The  consequent  orthogonality  of  the  error  IJ2  and  the  estimate  V2  is  readily  shown: 

(v'2’-v2  )-(*;*•  v2 ) 

(vi'v2)^<2  (v;--v2) 

=  o.  (6) 

In  addition,  the  error  vector  is  orthogonal  to  the  input  vector  V* : 

v;'-v2-(v;'-v2)-(v;-.v2) 

*  ■  ^12  (v*f  *  Vx  )  +  ^12  (  vIf  •  vx) 

-  0.  (7) 
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To  complete  this  one-stage  filter,  an  output  vector  U1  is  defined  which  is  equal  to  and 
therefore  orthogonal  to  the  error  output  U2, 


Ui=Vi, 

such  that  now  defined  are  orthogonal  vector  outputs  with  the  matrix  relationship 


(8) 


(9) 


The  outputs  may  be  further  transformed  to  have  a  norm  of  unity  if  desired,  but  this  will 
not  be  necessary  for  the  networks  considered  herein. 


This  filter  is  a  true  linear  prediction  filter  [7] ,  because  it  is  attempting  to  form  an 
estimate  of  the  input  signal  V2  in  Eq.  (2)  with  its  single  degree  of  freedom  represented  by 
the  weight  coefficient  W12.  The  quality  of  that  estimate  will  depend  in  part  on  whether  or 
not  the  data  sequences  of  m  samples  represent  adequate  sampling  of  the  input  signal  wave¬ 
forms. 


This  one-stage  filter  constitutes  a  building  block  for  constructing  multiple-input 
optimal  filters  of  greater  complexity  [2] ,  and  the  one-stage  filter  can  be  implemented  in 
several  ways.  For  example,  in  a  digital  system  incorporating  a  computer  of  sufficient 
capacity,  one  would  compute  the  optimum  weight  directly  per  Eq.  (5)  from  stored  data 
samples.  This  is  sometimes  referred  to  in  the  literature  as  open-loop  processing  [8]  and  is 
generally  preferred  whenever  it  can  be  implemented.  However,  direct  computation  is  not 
always  cost  effective  or  even  possible  because  of  system  considerations  such  as  analog 
component  preference,  hybrid  analog/digital  designs,  or  limited  computer  capacity.  For 
these  cases  one  may  consider  implementation  of  the  building  block  via  closed-loop 
processing,  which  involves  an  error-feedback  technique.  The  most  practical  of  these 
techniques  to  date  is  the  Howells- Applebaum  adaptive  algorithm  [1] ,  and  that  will  form 
the  basis  of  the  implementation  to  be  described  in  this  report. 


ONE-STAGE  FILTER  USING  A  FEEDBACK  ALGORITHM 

The  Howells-Applebaum  adaptive  algorithm  is  an  ideal  candidate  for  implementing 
the  one-stage  orthogonal-filter  building  block  described  in  the  previous  section,  for  the 
following  reasons: 

It  may  be  implemented  in  either  analog  or  digital  form; 

Data  storage  is  not  required; 

It  is  inherently  stable  and  robust; 

An  option  is  steering-control  input, 

It  is  simple  and  usually  inexpensive; 

Performance  is  usually  adequate. 


4 


NRL  REPORT  8409 


Figure  2  illustrates  schematic  diagrams  for  both  an  analog  and  a  digital  recursive  version. 
The  convergence  speed  of  this  algorithm  is  sometimes  criticized  as  being  too  slow  for  some 
applications,  but  a  solution  for  this  problem  has  been  developed  and  will  be  described  as  a 
modification  to  the  basic  algorithm. 


u. 

OUTPUT 


U* 

OUTPUT 


U,  In) 
OUTPUT 


U2(n) 

OUTPUT 


Fig.  2  —  One-stage  orthogonal  filter  based  on  the  Howells- Applebaum 
adaptive  feedback  algorithm 
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Analog  Implementation 

A  rather  complete  discussion  of  a  single  Howells-Applebaum  analog  control  loop 
similar  to  Fig.  2a  is  contained  in  Ref.  9,  and  it  is  shown  there  that  this  adaptive  loop  may 
be  represented  by  the  simple  first-order  follower-servo  schematic  diagrams  illustrated  in 
Fig.  3.  That  analysis  will  not  be  repeated  here,  but  review  of  a  few  of  the  fundamentals  is 
necessary  in  order  to  introduce  a  new  dynamic  time  constant  and  conversion  to  a  stable 
digital  formulation. 


-I 


(a)  Type-1  follower  servo 


(b)  Equivalent  circuit  of  a  one-stage  filter 


Fig.  3  —  Schematic  diagrams  of  feedback  servo  loops 

The  differential  equation  for  the  RC-filter  output  voltage  V  may  be  written  as 

dV  /  *  \ 

TdT*Vmg\V'U*)’  <10> 
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where  t  =  RC  is  the  filter  time  constant,  g  is  a  gain  constant,  and  the  remaining  variables  are 
complex  and  functions  of  time.  The  product  within  parentheses  is  the  input  from  the 
correlator  mixer,  and  it  can  fluctuate  rapidly  in  accordance  with  the  channel  passband, 
whereas  V  will  fluctuate  more  slowly  in  accordance  with  the  filter  closed-loop  passband.  To 
permit  V  to  remain  reasonably  independent  in  a  statistical  sense  from  the  rapid  input  signal 
fluctuations,  one  generally  imposes  the  restriction  that  the  (two-sided)  filter  closed-loop 
passband  2f3  must  not  exceed  approximately  10%  of  the  receiver  channel  passband  Bc  : 


2nB„ 

^  C 

restriction  2coa  < 

3  10 


(11) 


The  solution  of  Eq.  (10)  for  the  transient  behavior  of  V  then  requires  taking  the 
expected  value  and  assuming  a  step-function  input.  The  expected  value  of  the  correlator 
input  may  be  written 

n(v\v2)-&{v‘tv2)  +  w^&(V1v1)  (12) 

and 

*12=S*-  V,  (13) 

where  S*  is  the  optional  steering  weight.  Substitution  of  Eqs.  (12)  and  (13)  into  Eq.  (10) 
then  gives  the  servo-loop  working  equation: 

Tdf+  V  =  M(l'<"  V)»  (14) 

where 

u  =  S*  -  Wq  (equivalent  input), 


(optimum  weight), 


(servo  gain  factor).  (17) 

The  expected-value  operators  in  Eqs.  (16)  and  (17)  define  an  average  or  mean  taken 
over  infinite  time,  such  that  IV 0  is  generally  referred  to  as  the  least-mean-square  (LMS) 
optimum  weight.  It  closely  resembles  Eq.  (5),  which  represents  a  summation  average 
taken  over  a  finite  number  of  samples.  Under  steady-state  conditions,  under  which  the 
first-derivative  term  in  Eq.  (14)  vanishes,  the  controlled  weight  becomes, 

S*  p 

steady-state  W1Z  =  WQ  .  (18) 


el 

Vv 

r  i v 

.) 

si 

i 

\vi 

Is) 

**  =*S(  lVJ2) 


(15) 

(16) 
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The  weight  IV  j  2  approaches  W0  whenever  the  servo  gain  factor  becomes  large  (p  1),  thus 
resulting  in  the  desired  orthogonal  outputs. 

The  gain  g  is  adjusted  under  conditions  of  quiescent  channel  receiver  noise  to  result 
in  a  minimum  value  of  p,  which  is  denoted  as  p0  and  generally  set  equal  to  unity.  By  intro¬ 
ducing  a  SNR  power  ratio  Pr  for  channel  1,  one  can  conveniently  express  p  in  terms  of  p0 
and  Pr  : 


P  =  PoPr ■  (19) 

Under  quiescent  noise  conditions  such  that  Pr  is  unity  and  W0  is  zero  (independent  channel 
receiver  noise  being  assumed),  Eq.  (18)  shows  that  the  steady-state  value  of  IVj  2  approaches 
S*  '(1  +  p0);  that  is,  it  is  determined  by  the  steering  weight.  Thus  the  controlled  weight  IVj  2 
transitions  smoothly  between  the  steering  value  and  the  optimum  value  in  accordance  with 
the  power  level  of  the  input  signal. 

Integration  or  averaging  takes  place  in  accordance  with  the  reciprocal  of  the  closed- 
loop  bandwidth  to3,  which  is  readily  determined  from  Eq.  (14)  to  be 

JL _ t _ (20) 

u3  1  +  p  a 

that  is,  the  effective  averaging  decreases  as  p  increases.  This  variation  with  power  level  creates 
a  problem  in  selecting  a  fixed  value  for  r,  because  it  would  have  to  be  chosen  with  a  magni¬ 
tude  large  enough  to  avoid  the  condition  commonly  referred  to  as  noisy  weights.  Substitut¬ 
ing  restriction  (11)  into  Eq.  (20)  results  in 


10 
1 TB_ 


(1  +M), 


(21) 


where  Bc  is  the  channel  bandwidth.  Equation  (21)  shows  that  r  must  be  selected  for  the 
largest  power  level  to  be  encountered,  and  this  generally  causes  it  to  be  much  larger  than 
desired  at  low  power  levels. 


One  solution  to  this  problem  is  to  implement  a  new  dynamic  time  constant  Td  which 
varies  with  power  level  in  accordance  with  the  relationship 


Td  = 


(22) 


where  r0  is  a  fixed  value  selected  solely  for  quiescent  noise  conditions.  The  averaging  as 
given  by  Eq.  (20)  now  becomes 


1 

a 


To  + 


10 


F  P 


(23) 
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♦ 


which  never  violates  the  criterion  of  Eq.  (21)  and  yet  becomes  no  worse  than  approximately 
r0/(l  +  p0)  under  quiescent  noise  conditions.  This  modification  to  the  basic  Howells- 
Applebaum  algorithm  could  be  implemented  via  monitoring  the  power  (square-law  detector) 
in  the  channel  and  using  the  resultant  current  to  drive  an  electronic  RC  low-pass  filter 
circuit. 

Regarding  stability,  consider  Fig.  3a  and  its  differential  equation  (14).  The  Laplace 
transform  of  an  impulse  response  gives  the  transfer  function  for  the  servo: 

(24) 

S  +  a 


where 


a  = 


Otfi 

1  +A» 


(25) 


and  a  is  defined  in  Eq.  (20).  Since  a  is  always  a  positive  real  number,  the  convergence  condi¬ 
tion  for  H(s )  is  always  satisfied,  and  the  follower  servo  is  unconditionally  stable.  The  system 
impulse  response  will  be  the  inverse  Laplace  transform  of  H(S): 


/(f)  =  ae~at, 

which  is  the  familiar  decaying  exponential  associated  with  this  type  of  circuit. 


(26) 


Digital  Implementation 

Consider  next  the  representation  of  the  continuous  time  signals  of  the  analog  circuit 
with  digital  equivalents,  which  are  really  numerical  sequences  obtained  via  periodic  sampling 
as  illustrated  by  the  simple  sketch  in  Fig.  4.  The  nth  sample  of  the  sequence  of  samples  may 
be  denoted  asy(n): 


y(n)  =  y(f)  5 (t-  nT), 


(27) 


Fig.  4  —  Periodic  sampling  of  •  continuous  function  y(t)  at 
instants  nT,  to  obtain  an  equivalent  numerical  aequence 
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where  n  is  an  integer,  T  is  the  sampling  period,  and  5  is  the  usual  impulse  function.  The 
conversion  of  Eq.  (14)  to  digital  form  presents  an  option-choice  problem  in  that  there  are  at 
least  three  ways  of  expressing  the  first  derivative,  none  of  which  are  precise.  With  use  of 
Fig.  4,  the  first  derivative  may  be  written 


or 


dy(t) 

dt 


t=nT 


dy(t) 

dt 


t=nT 


[y("  +  D 


(forward  difference), 


y(n  ~  1) 


] 


(central  difference), 


dy(t) 

dt 


t*nT 


y(n)~  y(n  -  1) 


(backward  difference). 


Obviously  these  approximations  require  that  y(t)  should  not  have  frequency -spectrum 
components  exceeding  about  10%  of  the  sampling  rate,  and  preferably  much  less.  The 
question  is  whether  or  not  there  is  a  preference  in  the  difference  equations,  given  that  the 
digital  processing  may  involve  wide  swings  in  parameter  values.  Thus  the  three  difference 
equations  were  examined,  of  which  the  two  most  important  are  reported  here. 

Forward-Difference  Digital  Diagram 


When  the  first  derivative  is  written  as  a  forward  difference,  Eq.  (14)  may  be  expressed 
in  the  form 


~  V(n  +  1)  ^  -  1 )  V(n)  +  n  £u,-(n)  -  V(n)J  ,  (28) 

where  the  next  value  V(n  +  1)  is  calculated  on  the  basis  of  current  values  V(n)  and  i>,(n). 

This  equation  leads  naturally  to  the  diagram  of  a  forward-difference  digital  follower  servo 
shown  in  Fig.  5a.  The  box  labeled  Z~x  is  a  standard  notation  in  Z  transforms  [10]  to 
denote  a  unit  interval  delay  such  that  V(n  +  1)  is  transformed  to  V(n)  at  its  output.  The 
recirculation  of  V(n)  through  the  delay  constitutes  integration.  After  Z  transforms  of  Eq. 
(28)  are  taken,  the  servo-system  transfer  function  is  found  to  be 

W)  “  ~Z^~B  '  (29) 

where 


a 


B 


T 

=  M  . 

-[-(— Xfj- 
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(a)  Forward -difference  derivative 


Fig.  5  —  Digital-diagram  representation 
of  an  analog  type-1  follower  servo 


and 


Z  =  pe'w. 

When  Ip  I  *  1,  Z  is  constrained  to  the  Z-plane  unit  circle,  where  H(Z)  becomes  and 

there  is  a  physical  frequency  response  or  Fourier  transform  corresponding  to  the  impulse 
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response  of  the  system.  Because  of  the  periodic  sampling,  go  is  a  normalized  frequency  which 
must  be  expressed  in  terms  of  T  or  the  equivalent  cutoff  frequency  fc  : 


GO 


2irfT  =  t: 


(30) 


Only  under  this  condition  is  the  analog  Fourier  transform  equal  to  the  discrete-time 
Fourier  transform  [10] ,  and  it  applies  only  to  band-limited  functions.  The  stability  and 
convergence  conditions  for  H(Z)  require  that 


\Z\>  lBl<  1.  (31) 

This  restriction  on  the  value  of  B  is  emphasized  in  the  system  impulse  response  derived  from 
the  inverse  transform  of  H(Z): 


h(n)  =  a  Bn~ 1  u(n  -  1),  (32) 

where  u(n  1)  is  the  unit  step  sequence.  Obviously,  this  exponential  sequence  will  grow 
unstable  if  the  absolute  value  of  B  exceeds  unity,  so  that  one  must  be  careful  to  observe  the 
restriction 


T 

1-  (1+10  - 
r 


<1. 


(33) 


In  spite  of  this  danger  of  instability,  the  forward-difference  digital  equivalent  of  the  analog 
loop  has  been  the  digital  equivalent  most  frequently  discussed  in  the  literature  for  both 
the  LMS  and  the  Howells-Applebaum  algorithm  [11] .  The  reason  for  this  preference  will  be 
discussed  in  the  next  main  section. 

Backward-Difference  Digital  Diagram 

When  the  first  derivative  is  written  as  a  backward  difference,  Eq.  (14)  may  be 
expressed  in  the  form 


(1  +  j)  ^(n)  =  ~  V(n-  l)+fj  [t>(.(n)-  V(n)],  (34) 

where  the  current  value  V(n)  is  calculated  on  the  basis  of  the  previous  value  V(n  -  1)  and 
the  current  input  v,(n).  This  equation  leads  naturally  to  the  diagram  of  a  backward- 
difference  digital  follower-servo  shown  in  Fig.  5b.  The  recirculation  integrator  cannot  now 
become  growing  and  unstable.  It  can  only  become  decaying  for  finite  values  of  the  time 
constant.  After  Z  transforms  of  Eq.  i  34)  are  taken,  the  servo-system  transfer  function  is 
found  to  be 


H(Z)  = 


aB 

1  -  BZ'1  ’ 


(35) 


12 


NRL  REPORT  8409 


where 


1  +a  +  — 


7 

and  a  is  the  same  as  in  Eq.  (29).  The  stability  or  convergence  condition  is  again  given  by 
£q.  (31),  but  this  time  B  cannot  become  negative  or  exceed  unity.  It  cannot  even  equal 
unity  except  for  the  trivial  condition  of  zero  gain.  Thus  the  servo  is  unconditionally  stable 
for  all  values  of  the  parameters.  This  stability  is  further  reflected  in  the  system  impulse 
response  derive^  from  the  inverse  transform  of  H(Z): 

h(n)  =  aBn  *  1  u(n),  (36) 


where  u(n)  is  the  unit  step  sequence. 

Therefore,  the  backward-difference  digital  recursive  simulation  is  the  best  choice  for 
processing  in  the  digital  domain,  since  it  is  the  only  digital  simulation  option  which 
provides  the  same  unconditional  stability  as  the  analog  servo  circuit.  This  favorable  stability 
characteristic  was  recognized  by  Kretschmer  and  Lewis  [12] ,  who  arrived  at  a  backward- 
difference  recursive  relationship  via  an  indexing  approach.  The  final  digital  form  represented 
in  Fig.  2b  is  based  on  the  backward-difference  servo  diagram  of  Fig.  5b. 

Substituting  vi  =  (S*  -  H'q)  into  Eq.  (34)  results  in 

(1  +  p  +  j  )  V(n)  =  V(n  -  1)  +  p(S*  -  IF0),  (37) 

and  a  further  substitution  for  V  from  Eq.  (13)  results  in  the  backward-difference  controlled- 
weight  relationship 


(1+H+  pWl2{n)-^;  Wlt{n-  D+S*  VQ. 


(38) 


It  is  of  interest  to  compute  2(n)  under  quiescent  noise  conditions  wherein  IV 0  averages 
to  zero  and  p  becomes  p0  per  Eq.  (19): 


quiescent  lV12(rc) 


- _+ -  , 

1+*io  +  7T  1+^o+7 


(39) 
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and  convergence  is  reached  when  W12(n  -  1)  =  S*/(  1  +  Pq).  This  result  is  identical  to  that 
in  the  analog  case.  Furthermore,  under  high-level  signal  conditions  wherein  >5>  1, 

—  lVl2(n-l) 

lV12(n)= - + - ,  (40) 

T  r 
M»1  V*— 


and  convergence  is  reached  when  W12(n  -  1)  =  W0.  Again  this  result  is  identical  to  the 
analog  case. 

The  closed-loop  bandwidth  a  may.be  computed  from  the  system  transfer  function 
H(Z)  in  Eq.  (35)  on  the  Z-plane  unit  circle: 

aB 

H(  oj)  =  - 

1  -  Be->u 


T  T 

1  +  p  +  — (1-  cos  w)  +  ;  —  sin  cu 


(41) 


If  we  operate  sufficiently  below  the  sampling  rate  such  that  sin  w  85  w,  then  the  3-dB 
point  occurs  approximately  at 


<42> 

T 

which  is  similar  to  Eq.  (20)  in  the  analog  case.  The  noisy-weight  criterion  then  gives  an 
expression  similar  to  Eq.  (21)  in  the  analog  case, 

r  10 

(1+m).  (43) 

because  the  IF  bandwidth  Bc  is  also  the  sampling  rate  for  the  digital  video.  This  leads  to  the 
same  requirement  for  a  time  constant  which  varies  with  power  level  as  in  Eq.  (22)  in  the 
analog  case,  and  the  equivalent  digital  expression  becomes 


Td  10 

y-r0+7p. 


(44) 
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The  final  recursive  equation  set  is  obtained  simply  by  substituting  for  n  and  W0  their 
current  sequential  data  values.  Although  this  step  may  seem  abrupt,  the  reader  can  verify 
its  basis  by  going  back  to  Eq.  (10)  and  writing  the  equivalent  digital  equation  for  Fig.  2b  per 
the  backward  difference, 


r(n)  " 

~  V(n)~ 

T  L 

V(n-  1)  +V(n)=g  |V*(n)£/2(n)  , 

(45) 

which  introduces  the  current  data  update  of  the  correlator.  A  few  substitutions  then  result 
in  the  basic  backward-difference  controlled-weight  recursive  relationship  similar  to  Eq.  (38). 
The  complete  recursive  set  of  equations  is 

W12(n>  =  ^uln-D+S’  +M(n)W0(n), 

(46) 

where 

V>)  V2(n) 

V>)  Vj(n) 

(47) 

H(n)-g  ^(rO^Oi)]  , 

(48) 

and 

(49) 

in  which  Tf  S*  10/ir  (high-power  fast  time  constant).  The  heretofore  fixed  factor  10/ir  in 
Eq.  (49)  has  been  replaced  with  the  selectable  variable  7^,  which  really  represents  the 
high-power  fast  time  constant.  This  increases  the  flexibility  in  r(n),  and  an  example  will  be 
illustrated  later  in  which  it  was  necessary  to  increase  Tf  above  the  minimum  value  of  10/jr. 
The  reader  must  appreciate  the  difference  in  the  variables  listed  in  Eqs.  (46)  through  (48); 
that  is,  whereas  the  previous  quantities  p  and  W0  were  steady -state  expected  values  or  means 
which  were  used  to  derive  and  discuss  the  transient  characteristics  of  the  first-order  servo 
loop,  the  new  quantities  ji(n)  and  W0(n)  are  sequential  values  which  change  with  each  new 
set  of  incoming  data  samples  V1(n)  and  V2(n). 


A  recursive  relationship  like  Eq.  (46)  does  not  require  storage  of  any  incoming  data 
samples.  Instead  it  uses  the  data  samples  to  compute  a  weight  update  increment  consisting 
of  the  term 


tin)  W0(n) 


1  +  n(n)  + 


r(n) 


*0(n) 

1  *Tf  ’ 

for  ju(n) »  1, 

Wa(n) 

for  p(n)  *  1, 

2  +  Tf  +  r0  ’ 

(60) 
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where  the  expression  is  shown  evaluated  for  the  two  extremes  of  p(n).  The  update  gives 
equal  weighting  to  incoming  data  samples  if  the  magnitudes  of  the  samples  V1(n)  remain 
relatively  constant.  This  update  increment  is  added  to  the  previous  value  of  the  weight 
Hrl2(n  -  1),  which  is  multiplied  by  a  decay  factor: 


r(n) 

T 


1  +  P(n) + 


r(n) 


W12(n-  1) 


1  +  T4 


Wl2(n-1), 


for  p(n) » 1, 


T  +  f 

2  +  Tf  +  t0  Wl2(n~1)’  *<**»>*  1-  <51> 


Thus,  the  contributions  of  all  previous  data  samples  are  summed  (stored)  in  the  weight 
value  W12(n  -  1),  but  they  decay  or  fade  away  at  the  familiar  exponential  rate  of  1/e 
per  the  equivalent-time-constant  period.  From  Eqs.  (23),  (42),  and  (49)  the  equivalent 
time  constant  is 


!Tf,  for /ti(n)  »  1 

T0  +  Tf 

— - —  ,  forp(n)«l. 


(52) 


The  full  range  of  values  for  1/a  versus  SNR  power  ratio  Pr  (Eq.  (19))  is  plotted  in  Fig.  6 
for  typical  values  of  T,  =  10 /it  and  t0  =  200.  The  digital  integration  loop  circuit  of  Fig.  2b 
behaves  in  a  manner  almost  identical  to  the  analog  RC  filter  circuit  of  Fig.  2a  under  the 
conditions  assumed  herein. 


The  integration  action  upon  the  summed  weight  is  tantamount  to  increasing  its 
system  SNR  by  an  amount  approximately  equal  to  the  ratio  of  the  channel  bandwidth  to 
the  (two-sided)  RC  filter  bandwidth.  From  Eqs.  (20)  and  (23)  the  ratio  of  those  bandwidths 

is 


WTq  +  lOfi 
1+H 


10, 

*t0  +  1Q 
2 


for  fi  1, 


for  ft  ^  1. 


(53) 


Appearing  here  is  the  lower-limit  factor  of  10  originally  imposed  as  a  bandwidth  restric¬ 
tion  (Eq.  (11))  to  avoid  noisy  weights,  and  the  system  SNR  gain  then  increases  to  approxi¬ 
mately  wt0  / 2  as  input  power  ratio  Pr  decreases.  The  equivalent  digital  expression  simply 
requires  replacement  of  n  with  p(n). 
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POWER  RATIO  (dB) 

Fig.  6  —  Plot  of  the  dynamic  equivalent  time  constant  as  a  function  of  the 
power  ratio,  for  typical  values  Tf  -  3.2  and  rQ  «  200 

MULTICHANNEL  FILTERS  USING  THE  BUILDING  BLOCK 

The  one-stage  orthogonal-filter  building  block  described  in  the  previous  sections  may 
be  used  in  constructing  multichannel  multistage  adaptive  filters.  Alam  [2]  stresses  the 
building-block  approach,  and  he  proposes  a  clever  vehicle  in  the  form  of  an  orthonormal- 
lattice-filter  algorithm  which  is  a  unified  recursive  technique  to  estimate  the  least-squares 
coefficients  of  a  broad  class  of  linear  models.  It  consists  of  a  sequence  of  two  recursions. 
First,  the  Gram-Schmidt  orthonormalization  procedure  estimates  a  set  of  inner  products 
from  multiple  signal  vectors,  such  as  multichannel  sampled  observations.  A  lattice-type  net¬ 
work  structure,  suitable  for  adaptive  applications,  implements  the  Gram-Schmidt  procedure. 
Second,  a  recursion  is  introduced  to  transform  the  inner  products  into  model  coefficients. 

In  contrast  with  conventional  algorithms,  this  algorithm  does  not  require  the  covariance 
matrix  to  design  the  filters  but  directly  filters  the  observations.  He  discusses  a  number  of 
special  cases  of  the  multichannel  model  which  appropriately  simplify  the  general  structure 
of  the  orthonormal-lattice-filter  network. 

A  simplification  of  Alam’s  general  algorithm  lattice  network  has  been  chosen  as  a 
vehicle  for  demonstrating  the  application  of  our  building  block.  Also,  to  provide  a  more 
familiar  multichannel  adaptive  filter  for  base  line  performance  comparison,  the  building 
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block  has  been  applied  to  the  conventional  Howells-Applebaum  algorithm,  which,  like 
Alain's  algorithm,  does  not  require  the  covariance  matrix  and  directly  filters  the  observa¬ 
tions. 


Howells-Applebaum  Algorithm  Filter 

The  application  of  our  building  block  to  this  well-known  adaptive  algorithm  requires 
that  the  feedback  error  signal  must  now  consist  of  the  summation  of  many  adaptively 
weighted  channel  signals  (the  entire  array  output)  instead  of  just  two.  The  analog  form  of 
the  algorithm  has  received  such  extensive  coverage  in  the  literature  that  it  is  considered 
unnecessary  to  elaborate  further  herein.  For  the  digital  forms,  we  can  derive  from  Fig.  5 
by  inspection  the  two  recursive  equations  for  the  feth  weight  of  the  multichannel  filter. 

The  backward-difference  form  is 

(1  +  r)  Wk(n)  =  r  Wk(n  -  1)  +  S*h  -  g  £>)  F0(n),  (54) 

and  the  forward-difference  form  is 

r  Wk(n  +  1)  =  (r  -  1)  Wk(n)  +  S*  -  g  E*k(n)  F0(n),  (55) 

where 

K 

yQ(n)  =  Ek(n)Wk(n)  (array  output).  (56) 

*-l 

The  backward-difference  form  (Eq.  (54))  is  unconditionally  stable  like  its  analog  counter¬ 
part,  but  it  shares  the  same  difficulty  in  solving  the  simultaneous  equations;  that  is,  it 
requires  an  orthonormal-mode  solution,  which  becomes  a  prohibitive  computation  burden 
for  multiple  inputs.  The  forward-difference  form  (Eq.  (55)),  on  the  other  hand,  is  a  set  of 
independent  equations  which  do  not  require  any  additional  computation  burden.  Hence 
the  forward-difference  form  is  much  preferred  for  multiple  inputs  and  is  the  form  generally 
found  in  the  literature  [11] .  Its  instability  restrictions  are  a  small  price  for  the  convenience 
of  the  simpler  independent  set. 

The  backward-difference  form  can  also  be  made  independent  simply  by  inserting  an 
additional  delay  as  illustrated  in  Fig.  7.  Equation  (54)  remains  the  same  for  this  modifica¬ 
tion,  but  the  array  output  changes  to 

K 

y0(n)  =  £  Ek(n)  Wk(rt  -  1),  (57) 

A-l 


which  causes  the  feedback  error  update  to  become  independent  of  lV*(n).  This  modification 
has  instability  restrictions  slightly  better  than  the  forward-difference  form. 
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Fig.  7  —  Multichannel  Howells-Applebaum  adaptive  algorithm  in 
backward-difference  digital  recursive  form 


The  new  dynamic  time  constant  r(n)/T  given  by  Eq.  (49)  can  be  used  with  either 
form  simply  by  substituting  for  n(n)  as  follows: 

H(n)=g  (Yf(n)  •  E(n)]  ,  (58) 

where  g  can  be  replaced  by  the  quotient  of  p0  divided  by  the  mean  channel  quiescent  noise 
power  as  discussed  in  connection  with  Eq.  (19).  The  new  time  constant  is  valuable  for 
speeding  up  the  convergence  rate  in  comparison  to  a  fixed  time  constant,  but  it  cannot 
circumvent  the  basic  eigenvalue  transient  behavior  of  a  multiple-input  Howells-Applebaum- 
algorithm  adaptive  filter  [9] ; 

The  modified  backward-difference  form  is  the  form  used  for  all  reference  comparisons 
of  performance  in  this  report  and  shall  be  referred  to  as  the  baseline  Howells-Applebaum 
algorithm.  Its  stability  restriction  is  covered  by  the  restriction  placed  on  7y  in  Eq.  (49):  if 
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the  bandwidth  criteria  for  avoiding  noisy  weights  is  satisfied,  then  the  system  stability 
criteria  is  also  satisfied. 


Orthogonal  Lattice  Filter  of  One  Error  Output 

The  orthonormal-lattice-filter  network  of  Alam  is  illustrated  in  Fig.  8  for  the  case  of 
two  stages  or  three  input  channels.  It  is  a  complete  network  in  that  it  transforms  K  inputs 
into  K  orthonormal  error  outputs  where  the  feth  error  output  is  associated  with  the  original 
feth  input.  Its  transformation  action  makes  it  an  ideal  processing  mate  for  a  multiple-beam- 
antenna  spacial-filter  system  such  as  a  Butler  matrix,  where  one  could  then  obtain  an  error 
output  for  each  beam.  A  desirable  feature  of  Alam’s  network  is  that  the  symmetry  causes  a 
large  percentage  of  the  coefficients  to  be  identical,  thus  reducing  computation  burden.  It  is 
instructive  to  analyze  the  network  associated  with  just  one  of  these  error  outputs,  because  it 
clearly  illustrates  implementation  of  the  Gram-Schmidt  procedure  and  formation  of  the 
transfer  matrix  between  inputs  and  outputs.  In  addition,  such  a  network  provides  an 
orthogonal  transformation  of  its  own  which,  though  limited  and  not  eigenvector  in  charac¬ 
ter,  is  useful  for  some  adaptive  processing  situations. 

Thus,  consider  the  single-error-output  orthogonal-lattice-filter  network  shown  in  Fig.  9, 
which  derives  directly  from  Alam’s  diagram  in  Fig.  8.  Figure  9  also  illustrates  the  earlier 
Gram-Schmidt  cascade  processing  networks  described  by  Lewis  and  Kretschmer  [3]  and 
Brennan  et  al.  [4] .  Although  the  diagram  is  drawn  to  obtain  the  Kth  channel  error  output, 
it  could  just  as  easily  be  arranged  to  obtain  the  error  output  from  any  of  the  other  channels; 
that  is,  it  is  immaterial  as  to  which  channel  becomes  the  error  output  channel.  The  K 
channel-input  vectors  may  be  represented  as  a  single  stacked  input  vector: 

V=  [V1  V2V3  "  Vtf]  '•  <59> 

Likewise,  even  though  only  one  unique  error  output  channel  has  been  used,  all  outputs  are 
represented  as  the  stacked  output  vector 

u=[ut  U2  u3  ...U*]',  (60) 

and  the  transfer  matrix  T  is  sought  such  that 


U  =  T  V. 


(61) 
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Fig.  8  —  Two-stage  orthonormal-lattice-filter  network  of  Alam 
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The  transfer  matrix  will  derive  from  the  upper  triangular  matrix  which  corresponds  to 
the  natural  arrangement  of  weight  coefficients  in  the  network  This  upper  triangular  matrix 
can  be  defined  as 


o  wl2 
0  0 
0  0 
0  0 
0  0 

0  0 


*13 

*14 

*15  • 

■  *1K 

*23 

*24 

*25  ' 

*2K 

0 

*34 

*35  ■ 

*3K 

0 

0 

*4  5  • 

'  *4  K 

0 

0 

0 

*5K 

0 

0 

0 

0 

(62) 


where  each  weight  value  Wlk  represents  the  coefficient  obtained  from  the  one-stage-filter 
building  block  as  described  in  the  two  preceding  main  sections.  The  weight  coefficient 
either  may  be  computed  directly  in  accordance  with  Eq.  (5)  for  vector  inputs  of  m  data 
samples  or  may  be  estimated  in  real  time  via  the  analog/digital  network  of  Fig.  2. 


The  first  two  stages  in  the  process  are  illustrated  by  the  network  diagram  in  Fig.  10, 
which  shows  the  zero  stage  and  the  first  stage.  The  stage  will  be  indicated  by  an  additional 
subscript  on  the  channel  vector  such  that  V0fc  represents  the  zero-stage  output  vector  for 
the  fcth  channel,  Vlfc  represents  the  first-stage  output  vector,  V2k  represents  the  second- 
stage  output  vector,  etc.  Starting  with  the  zero  stage,  the  matrix  relationship  is 


V 


0  =  Ao  v> 


(63) 


Fig.  1  0  —  First  stage  of  a  multistage  K -channel  orthogonal 
lattice-filter  network  for  single-error  output 
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This  pattern  makes  it  evident  that  the  fcth-stage  transfer  matrix  consists  of  an  identity 
matrix  plus  the  transpose  of  the  ftth  row  of  weights  taken  from  the  upper  triangular  matrix 
of  lattice-network  weights  given  in  (62).  Furthermore  the  total  transfer  matrix  from  the 


24 


4 


» 


NRL  REPORT  8409 


original  input  to  the  output  of  the  fcth  stage  will  be  the  product  of  all  intervening  transfer 
matrices: 

Tfe  =  Ak  Ak-i  Ak-2  -  A1  ’  A0‘  ^69) 

For  K  input  channels,  there  will  be  K  stages,  such  that  the  final  transfer  matrix  from  the 
original  input  to  the  final  output  will  consist  of  a  lower  triangular  matrix  equal  to 

T  =  Ak_  j  Ak_  2  Ak_  3  ...  Aj  Aq,  (70) 

thereby  satisfying  the  requirement  of  Eq.  (61).  Since  each  stage  produces  one  additional 
orthogonal  output,  the  final  transfer  matrix  is  an  orthogonal  transformation  matrix  for 
the  set  of  input  vectors. 

The  availability  of  orthogonal  outputs  from  this  lattice  filter  gives  the  option  of  easily 
computed  optimum  weights,  since  the  sample  covariance  matrix  would  be  diagonal: 

Mu  =U*  U'=T*  V*  V'T'  =  T*  MT',  (71) 

where  M  is  the  sample  covariance  matrix  of  the  original  inputs.  Thus 

optimum  weight  WQ  =  M~3  S*  .  (72) 

To  illustrate  the  equivalence  of  output  and  input  optimization,  one  needs  only  to  compute 
the  optimum  output,  which  must  be  identical  for  both: 

output  =  U'WQ  =  Vf  T'  M'1  S* 

=  V'  T'  (T*  MT')’1  T*  S* 

=  M'3  S* 

=  v'  W0,  (73) 

which  assumes  that  the  transfer  matrix  is  nonsingular. 

Equation  (73)  shows  that  if  the  optimum  output  weights  Wq  are  known,  then  the 
optimum  input  weights  W0  may  be  determined  via  the  relationship 

W0=T*W0.  (74) 

Equation  (74)  will  apply  to  the  transformation  of  any  input/output  weight  sets,  not  just 
the  optimum,  provided  that  T  is  known  and  nonsingular. 

The  preceding  description  illustrates  Alam’s  claim  that  his  algorithm  arrives  at  the 
optimum  filter  weights  via  direct  filtering  of  the  observation  data  and  does  not  require  the 
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covariance  matrix  or  its  inverse.  The  equivalence  of  his  solution  to  the  conventional 
Weiner  filter  was  shown  in  Eq.  (73).  The  signal  input  vector  V^-  will  be  estimated  from 
the  entire  remaining  basis  set  of  signal  inputs  V j  through  VA-_j  and  therefore  should  be  an 
excellent  estimate  with  little  output  residual  error  U K . 

SIMULATION  PERFORMANCE  CHARACTERISTICS 

Some  typical  performance  characteristics  for  Alam’s  network  of  Fig.  9,  implemented 
with  the  building  block  of  Fig.  2b,  have  been  obtained  by  simulating  its  use  in  a  spacial- 
domain  linear  prediction  filter  consisting  of  a  weighted  linear  array  of  eight  spacial  sensor 
elements,  equally  spaced.  The  concept  of  the  filter  is  illustrated  in  Fig.  11,  where  the 
aim  is  to  estimate  the  signal  arriving  at  the  right-hand  unweighted  element  by  subtracting 
the  remaining  weighted-element  signals  and  minimizing  the  output  error  power.  More 
background  on  this  type  of  filter  is  given  in  Refs.  7  and  13. 


Fig.  1 1  —  Model  of  the  array-aperture  linear-prediction 
spacial  filter 


The  element  signal  samples  are  correlated  in  both  space  and  time,  but  this  is  converted 
to  the  spacial  domain  only  by  the  assumption  that  narrowband  filtering  precedes  the 
spacial-domain  processing. 


NRL  REPORT  8409 


The  nth  "snapshot”  signal  sample  at  the  feth  element  will  consist  of  independent 
Gaussian  receiver  noise  T}kn  plus  /  incoherent  source  voltages: 

1 

Ej(ku.  *  <b.  ) 

J,e  ‘  ",1  (75) 

i=l 


where  ut 

=  2^ r(d/X)  sin  0,, 

d 

=  element  spacing,  assumed  near  X/2, 

X 

=  wavelength, 

o, 

=  spacial  location  angle  of  the  ith  source, 

J, 

=  amplitude  of  the  ith  source,* 

<t>in 

=  random  phase  of  the  nth  sample  of  the  ith  source 

k 

=  element  index, 

n 

=  snapshot  sample  index. 

A  snapshot  is  defined  as  one  simultaneous  sampling  of  the  aperture  signals  at  all  array 
elements,  and  it  is  assumed  that  N  snapshots  of  data  are  available. 

The  quiescent  spacial  pattern  for  this  type  of  filter  is  intended  to  be  a  wide-beamwidth 
function,  so  that  the  steering  vector  S*  is  selected  to  inject  a  zero  weight  on  every  element 
except  the  end  element: 


S*'=  [0,0,  0,0,  0,0,  0,1].  (76) 

Thus  ,  the  quiescent  pattern  is  nominally  that  of  the  single  end  element  and  will  adequately 
cover  the  spacial  domain  between  ±90°.  In  applying  this  steering  vector  to  Fig.  9,  one 
simply  chooses  S*(n)  =  0  for  each  building  block  (Fig.  2b)  and  notes  that  the  end  channel  is 
of  unity  weight  by  network  construction.  Figure  12a  illustrates  typical  quiescent  spacial 
pattern  plots  for  the  case  in  which  there  are  no  external  sources  and  the  element  signals 
consist  only  of  the  independent  receiver  channel  noise.  These  patterns  were  computed  from 
weight  sets  (given  by  (62))  corresponding  to  snapshots  200,  400,  500,  600,  700,  800,  900, 
and  1000.  These  filter-function  patterns  always  fluctuate  with  time,  and  the  quiescent 
fluctuation  tolerance  is  what  determines  the  value  of  r0  in  the  dynamic  time  constant  of 
Eq.  (49).  To  directly  illustrate  the  effect  of  t0.  Fig.  12b  shows  the  patterns  computed  from 
the  same  snapshot  data  run  as  Fig.  12a  except  that  the  value  of  r0  was  reduced  by  i  factor 
of  10.  The  fluctuations  of  Fig.  12b  are  considerably  greater  and  would  be  unaccept  tble  for 
the  present  purposes. 

Although  not  shown  here,  the  quiescent  pattern  fluctuations  for  the  baseline  Howells- 
Applebaum  algorithm  are  similar  to  Fig.  12a  when  the  same  steering  vector  (Eq.  (76))  and 
same  dynamic  time  constants  (Eq.  (49))  are  used. 


•« I,  has  a  constant  rather  than  random  amplitude  because  of  a  concurrent  measurement  program  involving 
CW  sources  sampled  at  random  times. 
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(b)  Quiescent  time  conitant  rQ  -  20 


Fig-  12  —  Typical  example*  of  quieaccnt  pattern*  for  a  (ingle-element  illumination 
mainbeam,  an  eight-element  linear  array,  and  no  external  tpacial  aource* 
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Single  Strong  Source 

The  convergence  performance  of  the  orthogonal  lattice  filter  against  a  single  30-dB 
source  at  21°  is  shown  in  Fig.  13a,  where  the  error  output  power  in  decibels  above  receiver 
noise  level  is  plotted  against  time  measured  in  snapshot  counts.  Two  symbols  are  used  to 
plot  the  error  output  for  each  snapshot  data  sample: 

+  =  current  weights  Wik(n)  applied  to  the  current  input  snapshot, 

*  =  previous  weights  lFlfe(n  -  1)  applied  to  the  current  input  snapshot. 

This  option  is  available  because  the  building  block  of  Fig.  2b  permits  application  of  the 
current  updated  weight  to  the  data  sample  of  the  current  input  snapshot.  Thus,  on  the 
first  snapshot  the  asterisk  plots  at  30  dB,  corresponding  to  the  30-dB  source  and  quiescent 
element  weights  (Eq.  (76)),  whereas  the  plus  symbol  involves  the  first  weight  update 
W(fe(l)  and  is  already  partially  nulling  out  the  source  down  to  17  dB  at  the  output.  Con¬ 
vergence  to  receiver  noise  level  occurs  by  the  third  snapshot,  corresponding  roughly  to  the 
dynamic  time  constant  of  Fig.  6  for  a  30-dB  power  ratio.  There  is  not  much  difference 
between  the  two  symbol  plots  after  convergence. 

For  comparison,  the  convergence  performance  of  the  baseline  Howells- Applebaum 
algorithm  against  the  data  samples  of  the  same  source  is  shown  in  Fig.  13b.  The  option  of 
the  plus-symbol  plot  is  not  available  with  this  algorithm  because  the  updated  weights 
cannot  be  applied  to  the  current  snapshot  data  sample.  Instead  a  continuous-line  plot  of  the 
rms  eigenvalue  transient  solution  has  been  included  based  on  the  averaged  sample  covariance 
matrix,  with  a  fixed  time  constant  of  23,600  being  used.  The  asterisks  cluster  reasonably 
close  to  the  rms  curve  for  this  particular  case,  as  would  be  expected,  and  about  20  snap¬ 
shots  are  required  for  this  simple  algorithm  to  converge  to  receiver  noise  level.  After  con¬ 
vergence,  the  asterisks  have  almost  identical  plot  locations  for  the  two  algorithm.., 
indicating  that  the  same  optimum-weight  solution  has  been  reached. 

Figure  14  illustrates  a  few  typical  adapted  spacial-filter  patterns  computed  from  the 
orthogonal-lattice  filter  weight  sets  corresponding  to  snapshots  3, 10,  30,  90,  and  120. 

The  deep  null  on  the  single  strong  source  position  remains  stable,  whereas  the  spacial 
“passband  ripple”  will  fluctuate  like  the  quiescent  patterns  of  Fig.  12a. 


Two  Incoherent  Strong  Sources  Closely  Spaced 

Convergence  performance  of  the  orthogonal  lattice  filter  against  two  incoherent  30-dB 
sources  at  18°  and  22°  is  shown  in  Fig.  15a.  The  first  snapshot  asterisk  was  at  about  35  dB 
and  did  not  plot  here.  Convergence  to  receiver  noise  level  required  about  seven  snapshots 
for  this  case. 

For  comparison,  the  performance  of  the  baseline  Ho  wells- Applebaum  is  shown  in 
Fig.  15b,  which  shows  that  about  60  snapshots  are  required  for  convergence.  The  transient 
solution  for  the  rms  eigenvalue  used  a  fixed  time  constant  of  43,600  and  results  in  a 
longer  convergence  time  than  the  new  dynamic  time  constant.  The  reason  for  this  divergence 
is  that  the  dynamic  time  constant  takes  advantage  of  instantaneous  opposing  source  signal 
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(a)  Orthogonal-lattice-filter  algorithm 


Tim  m  gnapSHOT  counts 


(b)  Baseline  Howella-Applebaum-filter  algorithm 


Fig.  13  —  Time-aequence-anapahot  filter  error  output  in  decibels  above  the  receiver 
noise  level  for  a  single  30-dB  special  source  at  21° 


•FACIAL  ANCLE  IN  DCOAIIf 


Fig.  14  —  Typical  example!  of  ipacial-filter  pattern!  computed  from  orthogonal-lattice 
filter  weight  aeti  after  convergence,  for  a  lingle  30-dB  ipacial  aource  at  21° 


NRL  REPORT  8409 


* 


vectors  which  cause  low  snapshot  power  and  thus  permit  a  bigger  weight  update  bite.  The 
convergence  time  has  increased  so  much  for  this  algorithm  that  it  was  necessary  to  increase 
the  time  scale. 

Figure  16  illustrates  a  few  typical  adapted  spacial-filter  patterns  for  this  case,  computed 
from  the  orthogonal-lattice-filter  weight  sets  corresponding  to  snapshots  7, 10,  30,  90,  and 
121.  Two  characteristics  typical  of  multiple-source  adaptive  filtering  begin  to  show  here. 
First,  the  spacial  passband-ripple  fluctuations  increase  in  magnitude  as  the  number  of  degrees 
of  freedom  (polynomial  zeros)  devoted  to  them  decreases.  This  case  has  only  five  out  of 
seven  available,  whereas  the  case  shown  in  Fig.  14  has  six.  Second,  the  deep  nulls  on  the 
strong  sources  require  a  longer  time  to  become  stable,  and  their  fluctuations  increase,  as 
the  number  of  captured  degrees  of  freedom  increases  [9] . 


Fig.  16  —  Typical  examples  of  spacial-filter  patterns  computed  from  orthogonal -lattice- 
filter  weight  sets  after  convergence,  for  two  30-dB  spacial  sources  at  18°  and  22° 


Three  Incoherent  Strong  Sources  Closely  Spaced 

Convergence  performance  of  the  orthogonal  lattice  filter  against  three  incoherent 
30-dB  sources  at  14°,  18°,  and  22°  is  shown  in  Fig.  17a,  which  shows  that  about  20 
snapshots  are  required  for  getting  down  into  the  receiver  noise  level.  For  comparison, 

Fig.  17b  shows  the  performance  of  the  baseline  Howells-Applebaum  algorithm  for  the 
same  snapshot  data  samples,  and  it  is  obvious  that  convergence  will  require  thousands  of 
snapshots.  One  must  conclude  that  the  Howells-Applebaum  algorithm  is  unacceptable  for 
cases  like  this. 
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(a)  Orthogonal-lattice-filter  algorithm 


Pig.  17  —  Time-sequence-snapshot  filter  error  output  in  decibels  above  the  receiver  j 

noise  level  for  three  30-dB  special  sources  at  14s,  18s,  and  22s  j 
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Figure  18  illustrates  a  few  typical  adapted  spacial  filter  patterns  for  this  case,  computed 
from  the  orthogonal-lattice-filter  weight  sets  corresponding  to  snapshots  10,  30,  60,  90,  and 
121.  The  deterioration  in  passband-ripple  fluctuations  and  the  deep-null  fluctuations 
addressed  earlier  has  become  unacceptable  for  locating  spacial  filter  sources  even  though 
convergence  to  the  receiver  noise  level  has  been  satisfactorily  achieved. 


Fortunately  the  major  problem  here  is  simply  one  of  insufficient  integration;  that  is, 
the  value  of  Tf  =  3.2  in  the  dynamic  time  constant  is  too  fast  and  does  not  provide  a 
sufficient  number  of  data  samples  for  the  complicated  array-aperture  signal  waveforms 
produced  by  the  three  simultaneous  sources.  To  directly  illustrate  this  point,  Fig.  19  shows 
a  few  typical  adapted  spacial-filter  patterns  for  this  same  case  except  that  Tf  has  been 
increased  by  a  factor  of  10  to  the  value  32.  These  patterns  were  computed  from  the 
orthogonal-lattice-filter  weight  sets  corresponding  to  snapshots  200,  300,  400,  500,  700, 
and  900.  Here  both  the  passband-ripple  and  the  deep-null  fluctuations  have  settled  down 
satisfactorily.  Of  course,  the  increased  value  for  Tt  will  result  in  a  slower  transient  con¬ 
vergence  time  for  the  filter  amounting  to  about  70  snapshots  for  this  example.  Thus  the 
spacial-filter  resolution  of  multiple  sources  closely  spaced  requires  a  tradeoff  between  speed 
of  response  and  pattern  stability. 
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SPACIAL  ANCLE  IN  DEGREES 

Fig.  19  —  Typical  examples  of  spacial-filter  patterns  computed  from  orthogonal-lattice- 
filter  weight  seU  after  convergence,  with  a  fast  time  constant  7>  =  32,  for  three  30  dB 
special  sources  at  14  ,18  ,  and  22 
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CONCLUSIONS 

A  building  block  for  adaptive  filter  processors  has  been  described  which  consists  of 
the  Howells- Applebaum  algorithm  modified  to  incorporate  a  dynamic  time  constant. 

It  can  be  implemented  in  either  analog  or  digital  form,  data  storage  is  not  required,  it  is 
unconditionally  stable,  and  the  dynamic  time  constant  gives  it  great  application  flexibility. 
It  offers  a  viable  alternative  to  direct  computation  of  the  optimum  weight. 

The  building  block  is  designed  for  use  in  multichannel  multistage  adaptive  filters, 
and  a  particular  example  was  chosen  from  the  orthonormal-lattice-filter  algorithm  proposed 
by  Alam.  Performance  characteristics  for  this  Gram-Schmidt  processor  network  were 
simulated  in  a  spacial-domain  linear  prediction  filter  using  a  linear  array  of  eight  spacial 
sensor  elements.  The  transient  responses  and  adaptive  spacial  filter  patterns  were  computed 
for  one,  two,  and  three  strong  incoherent  sources  closely  spaced.  These  simulations 
demonstrated  that  the  building  block  has  sufficient  transient  response  speed  to  permit 
full  use  of  the  inherent  processing  capabilities  of  such  networks. 

With  this  type  of  network,  there  is  no  limitation  on  convergence  speed  per  se,  and 
convergence  time  is  dominated  by  other  considerations  such  as  the  number  of  degrees  of 
freedom  available  [11] ,  the  number  of  data  samples  required  by  a  given  signal  operating 
environment,  and  quiescent  system  operating  requirements.  Several  examples  of  these 
factors  were  included  in  the  simulations. 
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